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(54) Image observation apparatus 

(57) In an image observation apparatus having an 
image pickup system for acquiring an outside image via 
an image pickup optical system and a display system 
for displaying the outside image acquired by the image 
pickup system on a display element and for guiding light 
from the display element via an eyepiece optical system 
to an eye, an outside optical axis of the image pickup 
optical system is approximately aligned with an exten- 
sion line of an eye-side optical axis of the eyepiece op- 
tical system, and an entrance pupil of the image pickup 
optical system is shifted toward the outside from a po- 
sition equivalent to an entrance pupil of the ocular opti- 
cal system. An image observation system has a pair of 
image observation devices for the left and right eyes of 
an observer. Each of the image observation devices has 
an image pickup system for forming an outside image 
on an image pickup device by an image pickup optical 
system, and a display system for guiding light from a 
display element displaying the outside image acquired 
by the image pickup system, to the observing eye by a 
display optical system. Each of the image observation 
devices is arranged so that the outside optical axis of 
the image pickup optical system is approximately 
aligned with an extension line of the eye-side optical axis 
of the display optical system. In the image observation 
system, the image pickup device of the image pickup 
system of each image observation device is shifted hor- 
izontally by a predetermined distance relative to the op- 
tical axis of the image pickup optical system, and the 
display element is shifted horizontally by a predeter- 
mined distance relative to the optical axis of the display 



optical system. The optical axes of the image pickup op- 
tical systems and the optical axes of the display optical 
systems in the pair of image observation devices for the 
left and right eyes are parallel to each other. 



FIG. 1 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention relates to image obser- 
vation apparatus and systems and is preferably appli- 
cable to image observation apparatus and systems, for 
example, constructed in such structure that a scene of 
the outside world (an outside image or outside informa- 
tion) captured by an image pickup optica! system (image 
pickup system) is displayed on a display device (image 
display means) to permit an observer to observe it, or 
to image observation apparatus and systems designed 
for the purpose of permitting the observer to have vari- 
ous pseudo experiences while displaying an image (vir- 
tual image) artificially produced by a computer or the like 
or an image recorded by a video system or the like over 
the real scene (outside information) on the image dis- 
play means. 

Related Background Art 

[0002] There are conventionally known image obser- 
vation devices constructed in such structure that the out- 
side image (outside information) is converted to an elec- 
tric signal by an image pickup device such as a CCD 
camera or the like, it is displayed on a display device 
(display means) such as a CRT, an LCD or the like, and 
the observer is allowed to observe the outside image 
through an eyepiece optical system (such observation 
will hereinafter be referred to as "video seethrough ob- 
servation") as if he or she were observing the outside 
by the naked eye. 

[0003] There are also the image observation devices 
proposed in such structure that the outside image 
picked up by the camera is displayed in combination 
with the image created by computer graphics or the like 
or with an image recorded by the video system or the 
like so as to permit the observer to observe a synthetic 
scene of the real space and the virtual space. 
[0004] In the image observation devices of these 
structures, in order to match positions of objects etc. in 
the observing direction with those in the observation by 
the naked eye, the outside optical axis of the image pick- 
up optical system of the image pickup system is aligned 
with the eye-side optical axis of the eyepiece optical sys- 
tem of the display system and the entrance pupil of the 
image pickup optical system is located at the position 
equivalent to the entrance pupil of the ocular optical sys- 
tem. 

[0005] It is, however, expeimentally verified that, 
when the image pickup optical system is located at the 
exactly equivalent position against the ocular optical 
system, there arises the problem that an object dis- 
played on the image display means is perceived in the 
size smaller than that in the observation of the outside 



by the naked eye. 

[0006] Fig. 28 provides the results of experiments for 
comparison between perceived sizes in the observation 
by the naked eye and in the video seethrough observa- 

5 tion with a device wherein the image pickup optical sys- 
tem is located at the optically, exactly equivalent position 
relative to the ocular optical system, where an object of 
a certain size was observed at different distances. Fig. 
28 shows a graph of the perceived size of the object 

10 plotted against the distance to the object. 

[0007] In Fig. 28, the solid line represents the results 
in the observation by the naked eye and the dashed line 
the results in the video seethrough observation. It is un- 
derstood that the object in the video seethrough bbser- 

'5 vation is significantly perceived in the size smaller than 
that in the observation by the naked eye. 
[0008] Fig. 23 is a schematic diagram to show the 
main part of a conventional image observation system 
wherein a pair of image observation devices each hav- 
20 ing the image pickup system and the display system are 
provided for the left and right eyes of the observer. In 
the drawing, elements for the left eye are accompanied 
by suffix L and elements for the right eye by suffix R. It 
is noted that the suffixes L, R indicating the elements for 
25 the left and right eyes are omitted in the description be- 
low. 

[0009] In Fig. 23, each image pickup system 100 is 
composed of an image pickup optical system 1 01 and 
an image pickup device 102, and numeral 103 desig- 

30 nates the outside optical axis of the image pickup optical 
system. A mirror 1 04 separates optical paths of display 
system 11 0 from those of the image pickup system 1 00. 
Each display system 1 1 0 is composed of a display op- 
tical system 1 1 1 and a display element 112, and numeral 

35 113 designates the eye-side optical axis of the display 
optical system. 

[0010] A pair of such image observation devices each 
consisting of the image pickup system 1 00 and the dis- 
play system 11 0 are provided for the left and right eyes. 

40 e represents the observing eyes. 

[0011] The image pickup systems 100 and the display 
systems 1 1 0 illustrated in Fig. 23 are constructed in such 
structure that the center 102C of the image pickup de- 
vice 102 and the optical axis 103 of the image pickup 

45 optical system 1 0 T are matched with the center 1 1 2C of 
the display element 112 and the optical axis 113 of the 
display optical system and that the optical axes 103R, 
1 03L of the image pickup optical systems for the left and 
right eyes and the optical axes 1 1 3R, 1 1 3L of the display 

50 optical systems are inclined at the angle 6 so as to in- 
tersect at a reference position 1 20 located in the outside. 
[0012] A plane 112* (virtual image screen) in conju 
gate with the display element 112 with respect to each 
display optical system 1 1 1 is matched with a plane 1 02 1 

55 (focal plane) in conjugate with the image pickup device 
1 02 with respect to the image pickup optical system 1 01 , 
and center positions 102C, 112C of the respective 
planes are matched at the reference position 120. The 
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center positions for the left and right eyes are also 
matched at the reference position 120. 
[0013] Fig. 24 and Fig. 25 show a situation in which 
with the image observation system illustrated in Fig. 23, 
the object 130 in the outside space is imaged by the im- 
age pickup systems 100 to be displayed by the display 
systems 110 and in which the observer is observing the 
object image. 

[0014] In Fig. 24, the object 1 30 in the outside space 
is in focus on the image pickup devices 1 02 via the mir- 
rors 1 04 and the image pickup optical systems 1 01 to 
form images 131 thereon to be picked up. The position 
of each image corresponds to a spot 13V on the focal 
plane 1 02' conjugate with the image pickup device 1 02, 
and is a distance P apart from the center 1 20 of the focal 
plane. 

[0015] The image 131 of the object 130 taken by the 
associated pickup system 1 00 is displayed as an image 
132 on each display element 112 as illustrated in Fig. 
25. In Fig. 25 : light from each display element 112 is 
guided to the observing eye E by the mirror 104 and the 
display optical system 111. Each observing eye E ob- 
serves the corresponding image 132 as an image 132' 
on the virtual image screen 112' conjugate with the dis- 
play element 112. The position of each image 132* is a 
distance Q apart from the center 1 20 of the virtual image 
screen. 

[001 6] The observer observes the image 1 32'R by the 
right eye ER and the image 132'L by the left eye EL. 
This permits the observer to observe the object 130 as 
if it were actually present at an intersection 1 34 between 
the visual axis 133R of the right eye ER and the visual 
axis 133L of the left eye EL. At this time, where the en- 
trance pupil position of each image pickup optical sys- 
tem 101 is matched with the entrance pupil position of 
the corresponding observing eye E and where the angle 
of image pickup view and the angle of display view are 
equated, the position and size of the focal plane 102' of 
each image pickup system are matched with those of 
the virtual image screen 112' of the associated display 
system, so that the distance P becomes equal to the 
distance Q. Therefore, the position of the intersection 
134 becomes the same as the actual position of the ob- 
ject 130 in the outside space and the reproduced object 
size also becomes equal to that of the object 130. 
[0017] In the image observation system illustrated in 
Fig. 23, if the image pickup optical systems 101 have 
the zooming function or if the display magnification is 
varied by use of an electronic zoom or the like, there will 
occur cases in which the reproduced space is distorted 
or cases in which the observer fails to effect the fusion 
of the images for the left and right eyes. 
[001 8] This phenomenon will be described below with 
reference to Fig. 26, Fig. 27A, and Fig. 27B. Fig. 26 
shows a case of observation where the picked up imag- 
es of the object 130 in the outside space as illustrated 
in Fig. 24, acquired by the image pickup systems 100, 
are displayed at the magnification of 2 on the display 



elements to be observed. The distances S from the 
screen center 120, of the display images 135* on the 
virtual image screens 112' are twice the distances Q in 
Fig. 25. Just as in the case of Fig. 25, the observer can 

5 observe the object 1 30 as if it were actually present at 
the intersection 137 between the visual axis 136R of the 
right eye ER and the visual axis 136Lof the left eye EL. 
The observer can observe the object as if he or she be- 
came closer to the object or as if the object became larg- 

10 er. 

[0019] However, the visual axes of the left and right 
eyes can intersect with each other (or the left and right 
images can undergo fusion) only if the object 1 30 is with- 
in the XZ plane (Y = O). Fig. 27A is a YZ section in the 
15 state illustrated in Fig. 25 and Fig. 27B a YZ section in 
the state illustrated in Fig. 26. In Fig. 27A and Fig. 27B, 
suffixes y, z attached to Q and S indicate a Y-directional 
component and a Z-directional component thereof, re- 
spectively. 

20 [0020] As illustrated in Fig. 27A, where the images are 
picked up by the image pickup systems without use of 
the zooming function to be displayed by the display sys- 
tems and be observed, the visual axes 133R, 133L of 
the left and right eyes ER, EL agree in the YZ plane and 
thus intersect with each other even if the object 130 is 
not present in the XZ plane (Qy * 0). However, where 
the zooming function is used as illustrated in Fig. 27B, 
the visual axes 136R, 136L of the left and right eyes ER, 
EL do not agree in the YZ plane and thus do not intersect 
with each other. Deviation is permitted to some extent if 
it is small, but it will induce fatigue of the observer and 
distortion of the reproduced space. With large deviation, 
there will arise the problem of failure in the fusion of the 
left and right images. 

[0021] Not only in the cases using the zooming func- 
tion, but also in the cases wherein the angle of image 
pickup view does not agree with the angle of display 
view because of design factors, production errors, etc., 
the above-stated problem will arise. 

SUMMARY OF THE INVENTION 

[0022] An object of the present invention is to provide 
an image observation apparatus that permits the ob- 
server to observe the outside in like size in the video 
seethrough observation and in the observation by the 
naked eye. 

[0023] Another object of the present invention is to 
provide an image observation system that causes no 
distortion of the reproduced space and that permits the 
observer to succeed in the fusion of the images for the 
left and right eyes without stress even in the cases 
wherein the zooming function is used during the video 
seethrough observation, in the cases wherein the angle 
of image pickup view and the angle of display view do 
not agree with each other because of the design factors, 
production errors, etc., in the cases wherein the en- 
trance pupil position of the image pickup optical system 
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is not matched with the entrance pupil position of the 
observing eye, and so on. 

[0024] Another object of the present invention is to 
provide an image observation apparatus that can de- 
crease the size of the entire apparatus, so as to reduce 5 
the load on the observer when mounted-on the head. 
[0025] Another object of the present invention is to 
provide an image observation apparatus wherein the 
image pickup system is constructed of a prism with a 
surface having transmission action and total internal re- 10 
flection action, thereby permitting decrease in the size 
of the entire apparatus, efficiently guiding the outside 
light to the image pickup device, and readily obtaining 
a bright outside image. 

[0026] An image observation apparatus according to 15 
one aspect of the present invention is an image obser- 
vation apparatus comprising an image pickup system 
for acquiring an outside image via an image pickup op- 
tical system, and a display system for displaying the out- 
side image acquired by the image pickup system on dis- 20 
play means and guiding light from the display means via 
an eyepiece optical system to an eye, in which a position 
of an exit pupil of the eyepiece optical system is approx- 
imately matched with a position of an entrance pupil of 
an ocular optical system, so as to permit observation of 25 
the image, wherein an outside optical axis of the image 
pickup optical system is approximately aligned with an 
extension line of an eye-side optical axis of the eyepiece 
optical system and wherein an entrance pupil of the im- 
age pickup optical system is shifted toward the outside 30 
from a position equivalent to the entrance pupil of the 
ocular optical system. 

[0027] In a further aspect of the present invention, the 
following condition is satisfied: 

d < 60 (mm) where d is a shift amount of the en- 35 
trance pupil of said image pickup optical system relative 
to the position equivalent to the entrance pupil of said 
ocular optical system. 

[0028] In a further aspect of the present invention, an 
angle of image pickup view of the outside image ac- 40 
quired by said image pickup system is approximately 
equated to an angle of display view of display by said 
display system. 

[0029] In a further aspect of the present invention, the 
image observation apparatus comprises image gener- 45 
ating means for generating an image and image com- 
bining means for combining images, and said image 
combining means combines the image from the image 
generating means with the image from said image pick- 
up system to form a synthetic image and displays the so 
synthetic image on said display means. 
[0030] In a further aspect of the present invention, 
said image pickup system comprises a prism consisting 
of a plurality of planes, said prism comprises a plane 
having transmission action and total internal reflection 55 
action, and light having passed through the prism is 
guided to an image pickup device by an optical element 
having a positive optical power. 



[0031] In a further aspect of the present invention, 
said image pickup system comprises a decentered, ro- 
tationally asymmetric, reflecting surface with optical 
powers differing depending upon azimuthal angles. 
[0032] In a further aspect of the present invention, 
said display system comprises a decentered, rotation- 
ally asymmetric, reflecting surface with optical powers 
differing depending upon azimuthal angles. 
[0033] In an image observation system according to 
one aspect of the present invention, a pair of the image 
observation apparatus described above are provided for 
the left and right eyes of the observer. 
[0034] An image observation apparatus according to 
one aspect of the present invention is an image obser- 
vation apparatus comprising an image pickup system 
for acquiring an outside image via an image pickup op- 
tical system, and a display system for displaying the out- 
side image acquired by the image pickup system on dis- 
play means and guiding light from the display means via 
an eyepiece optical system to an eye, in which a position 
of an exit pupil of the eyepiece optical system is approx- 
imately matched with a position of an entrance pupil of 
an ocular optical system, so as to permit observation of 
the image, wherein said display system comprises a 
prism body having a decentered, rotationally asymmet- 
ric, reflecting surface with optical powers differing de- 
pending upon azimuthal angles, wherein an outside op- 
tical axis of the image pickup optical system is approx- 
imately aligned with an extension line of an eye^side op- 
tical axis of the eyepiece optical system, wherein an en- 
trance pupil of the image pickup optical system is shifted 
toward the outside from a position equivalent to the en- 
trance pupil of the ocular optical system, and wherein, 
where an amount of the shift is d, the shift amount d 
satisfies the following condition: 
d < 60 (mm). 

[0035] In a further aspect of the present invention, 
said image pickup system comprises a reflecting sur- 
face and a direction of deflection of the optical axis by 
the reflecting surface is a direction different from a di- 
rection of deflection of the optical axis by the reflecting 
surface of said display system. 

[0036] In a further aspect of the present invention, an 
angle of image pickup view of the outside image ac- 
quired by said image pickup system is approximately 
equated to an angle of display view of display by said 
display system. 

[0037] In a further aspect of the present invention, the 
image observation apparatus comprises image gener- 
ating means for generating an image and image com- 
bining means for combining images, and said image 
combining means combines the image from the image 
generating means with the image from said image pick- 
up system to form a synthetic image and displays the 
synthetic image on said display means. 
[0038] In a further aspect of the present invention, 
said image pickup system comprises a prism consisting 
of a plurality of planes, said prism comprises a plane 



4 



BNSDOCID:<FP 1f»ft?l7Al t * 



7 



EP1 098 217 A1 



8 



having transmission action and total internal reflection 
action, and light having passed through the prism is 
guided to an image pickup device by an optical element 
having a positive optical power. 

[0039] In a further aspect of the present invention, 5 
said image pickup system comprises a decentered, ro- 
tationally asymmetric, reflecting surface with optical 
powers differing depending upon azimuthal angles. 
[0040] In an image observation system according to 
one aspect of the present invention, a pair of the image 10 
observation apparatus in the structure described above 
are provided for the left and right eyes of the observer. 
[0041] An image observation system according to one 
aspect of the present invention is an image observation 
system in which a pair of image observation devices are *5 
provided for the left and right eyes of an observer, each 
of said image observation devices comprising an image 
pickup system for forming an outside image on an image 
pickup device by an image pickup optical system, and 
a display system for guiding light from a display element 20 
displaying the outside image acquired by the image 
pickup system, to the observing eye by a display optical 
system and each of said image observation devices be- 
ing arranged so that an outside optical axis of the image 
pickup optical system is approximately aligned with an 25 
extension line of an eye-side optical axis of the display 
optical system, wherein the image pickup device of the 
image pickup system of each image observation device 
is shifted horizontally by a predetermined distance rel- 
ative to the optical axis of the image pickup optical sys- 30 
tern, wherein the display element of each image obser- 
vation device is shifted horizontally by a predetermined 
distance relative to the optical axis of the display optical 
system, and wherein the optical axes of the image pick- 
up optical systems and the optical axes of the display 35 
optical systems in the pair of image observation devices 
for the left and right eyes are parallel to each other. 
[0042] In a further aspect of the present invention, fo- 
cus positions of said image pickup optical systems for 
the left and right eyes are matched with each other, shift 40 
amounts of said image pickup devices are set so as to 
match positions conjugate with centers of the respective 
image pickup devices by the image pickup optical sys- 
tems for the left and right eyes with each other, positions 
of virtual images of said display elements by the display 45 
optical systems for the left and right eyes are matched 
with each other, and shift amounts of the display ele- 
ments are set so as to match positions conjugate with 
centers of the respective display elements by the display 
optical systems for the left and right eyes with each oth- 50 
er. 

[0043] In a further aspect of the present invention, 
said focus positions are matched with said positions of 
the virtual images. 

[0044] In a further aspect of the present invention, an 55 
angle of image pickup view of the outside image by said 
image pickup system of each image observation device 
is approximately equated to an angle of display view of 



display by said display system. 

[0045] In a further aspect of the present invention, the 
image observation system comprises image generating 
means for generating an image and image combining 
means for combining images, and said image combin- 
ing means combines the image from the image gener- 
ating means with the image from said image pickup sys- 
tem of each image observation device to obtain a syn- 
thetic image and displays the synthetic image on said 
display element of each image observation device. 
[0046] In a further aspect of the present invention, 
said image pickup optical system of each image obser- 
vation device comprises a prism consisting of planes, 
said prism comprises a plane having transmission ac- 
tion and total internal reflection action, and an optical 
element having a positive optical power is placed in an 
optical path between the prism and said image pickup 
device. 

[0047] In a further aspect of the present invention, 
said image pickup optical system of each image obser- 
vation device comprises a decentered, rotationalfy 
asymmetric, reflective surface with optical powers dif- 
fering depending upon azimuthal angles. 
[0048] In a further aspect of the present invention, 
said display optical system of each image observation 
device comprises a decentered, rotationaliy asymmet- 
ric, reflecting surface with optical powers differing de- 
pending upon azimuthal angles. 

[0049] In a further aspect of the present invention, 
said image pickup optical systems are zooming optical 
systems. 

[0050] In a further aspect of the present invention, the 
image observation system comprises image processing 
means for changing a display magnification when the 
outside images acquired by said image pickup systems 
are displayed on said display elements. 
[0051 ] An image observation system according to one 
aspect of the present invention is an image observation 
system in which a pair of image observation devices are 
provided for the left and right eyes of an observer, each 
of said image observation devices comprising an image 
pickup system for forming an outside image on an image 
pickup device by an image pickup optical system, and 
a display system for guiding light from a display element 
displaying the outside image acquired by the image 
pickup system, to the observing eye by a display optical 
system and each of said image observation devices be- 
ing arranged so that an outside optical axis of the image 
pickup optical system is approximately aligned with an 
extension line of an eye-side optical axis of the display 
optical system via an optical member, wherein the im- 
age pickup device of the image pickup system of each 
image observation device is arranged so that a center 
thereof is shifted by a predetermined distance in a di- 
rection perpendicular to the optical axis of the image 
pickup optical system and wherein the display element 
of each image observation device is arranged so that a 
center thereof is shifted by a predetermined distance in 
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a direction perpendicular to the optical axis of the display 
optical system. 

[0052] In a further aspect of the present invention, the 
outside optical axes of said pair of image pickup optical 
systems for the left and right eyes are parallel to each 5 
other. 

[0053] In afurther aspect of the present invention, po- 
sitions of an object formed on said image pickup devices 
by said image pickup systems are matched with posi- 
tions where virtual images of said display elements are 10 
formed by said display systems. 

[0054] In afurther aspect of the present invention, ob- 
ject-side positions of centers of said image pickup de- 
vices by said image pickup systems are matched with 
positions where virtual images of centers of said display is 
elements are formed by said display systems. 
[0055] In a further aspect of the present invention, 
said image pickup optical system of each image obser- 
vation device comprises a decentered, rotationally 
asymmetric, reflecting surface with optical powers dif- 20 
fering depending upon azimuthal angles. 
[0056] In a further aspect of the present invention, 
said display optical system of each image observation 
device comprises a decentered, rotationally asymmet- 
ric, reflecting surface with optical powers differing de- 25 
pending upon azimuthal angles. 

[0057] In a further aspect of the present invention, a 
position of an entrance pupil of said image pickup optical 
system of each image observation device is shifted to- 
ward the outside from a position equivalent to an en- 30 
trance pupil of the observer's eye. 
[0058] In a further aspect of the present invention, 
where an amount of the shift of the entrance pupil of said 
image pickup optical system from the position equiva- 
lent to the position of the entrance pupil of said observ- 35 
er*s eye is d, the shift amount d satisfies the following 
condition: 

d < 60 (mm). 

BRIEF DESCRIPTION OF THE DRAWINGS 40 
[0059] 

Fig. 1 is a schematic diagram to show the main part 

of Embodiment 1 of the present invention; 45 

Fig. 2 is a schematic diagram to show the main part 

of Embodiment 2 of the present invention; 

Fig. 3 is a schematic diagram to show the main part 

of Embodiment 3 of the present invention; 

Fig. 4 is a schematic diagram to show the main part so 

of an image observation device for comparison with 

the present invention; 

Fig. 5 is a schematic diagram to show the main part 
of a modification obtained by modifying part of Em- 
bodiment 3 of the present invention; 55 
Fig. 6 is a schematic diagram to show the main part 
of a modification obtained by modifying part of Em- 
bodiment 3 of the present invention; 



Fig. 7 is a schematic diagram to show the main part 
of Embodiment 4 of the present invention; 
Fig. 8A and Fig. 8B are block diagrams to show the 
main part of a signal processing step in the image 
observation apparatus of the present invention; 
Fig. 9 is a schematic diagram to show the main part 
of the image observation system of the present in- 
vention; 

Fig. 10 is a schematic diagram to show the main 
part of the conventional image observation appara- 
tus; 

Fig. 11 is an explanatory diagram to illustrate the 
basic concept of the image observation system of 
the present invention; 

Fig. 12 is an explanatory diagram to illustrate the 
image pickup systems of Fig. 11 ; 
Fig. 13 is an explanatory diagram to illustrate the 
display systems of Fig. 11; 

Fig. 14 is an explanatory diagram to illustrate the 
image pickup systems of Fig. 11 ; 
Fig. 15A and Fig. 15B are explanatory diagrams to 
illustrate the display systems of Fig. 11 ; 
Fig. 16 is a schematic diagram to show the main 
part of Embodiment 5 of the image observation sys- 
tem of the present invention; 
Fig. 17 is an appearance diagram to show the ap- 
pearance of the image observation system of the 
present invention; 

Fig. 18 is a schematic diagram to show the main 
part of Embodiment 6 of the image observation sys- 
tem of the present invention; 
Fig. 19 is an explanatory diagram to show a modi- 
fication obtained by modifying part of Embodiment 
6 of the image observation system of the present 
invention; 

Fig. 20 is a schematic diagram to show the main 
part of Embodiment 7 of the image observation sys- 
tem of the present invention; 
Fig. 21 is a schematic diagram to show the main 
part of Embodiment 8 of the image observation sys- 
tem of the present invention; 
Fig. 22A and Fig. 22B are schematic diagrams to 
show the main part of the signal processing step in 
the image observation apparatus of the present in- 
vention and the image observation system; 
Fig. 23 is a schematic diagram to show the main 
part of the conventional image observation system; 
Fig. 24 is a schematic diagram to show the main 
part of the conventional image observation system; 
Fig. 25 is a schematic diagram to show the main 
part of the conventional image observation system; 
Fig. 26 is a schematic diagram to show the main 
part of the conventional image observation system; 
Fig. 27A and Fig. 27B are schematic diagrams to 
show the main part of the conventional image ob- 
servation system; and 

Fig. 28 is an explanatory diagram to illustrate the 
sizes of the object perceived in the observation by 
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the naked eye and in the video seethrough obser- 
vation. 

DETAILED DESCRIPTION OF THE PREFERRED 
. EMBODIMENTS 

(Embodiment 1) 

[0060] Fig. 1 is a schematic diagram to show the main 
part of Embodiment 1 of the image observation appara- 
tus according to the present invention. The image ob- 
servation apparatus S according to the present embod- 
iment has a display system 210 for guiding image infor- 
mation displayed on a display means 21 1 to an observ- 
ing eye E, and an image pickup system 220 for imaging 
image information OB in the outside on an image pickup 
device 223. The image information acquired by the im- 
age pickup system 220 is subjected to signal processing 
by a signal processing means SP to be converted into 
an electric signal and thereafter is displayed on the dis- 
play means 211 of the display system 210 to be ob- 
served, together with the other image information dis- 
played on the display means 211 , by the observing eye 
E. 

[0061] The display system 210 has the display means 
211 such as an LCD, an EL panel, or the like, an eye- 
piece optical system 212, and a mirror 213. The image 
pickup system 220 has the mirror 213, an image pickup 
optical system 221 having a positive optical power, and 
the image pickup device 223 such as a CCD or the like. 
[0062] First, the structure of the display system 210 
will be described below. In the present embodiment, dis- 
play light based on the image information and emerging 
from the display means 211 , which is composed, for ex- 
ample, of a backlight, a polarizer, a transmissive liquid 
crystal device, etc., travels through the eyepiece optical 
system 211, and is reflected by a surface 213a of the 
mirror 213 on the side of the display system 210 to be 
guided to the entrance pupil P of the observing eye E. 
The position, the focal length, etc. of the eyepiece opti- 
cal system 212 are determined so as to form an en- 
larged virtual image of the display element surface of 
the display means 211 , for example, 2 m ahead, and the 
position of exit pupil of the eyepiece optical system 21 1 
is matched with the position of entrance pupil P of the 
observing eye E. 

[0063] The image pickup system 220 will be de- 
scribed next. Light from the object OB in the outside is 
reflected by a surface 21 3b of the mirror 213 on the side 
of the image pickup system 220 to be focused on the 
image pickup device 223 by the image pickup optical 
system 221 . The outside optical axis 0 2 of the image 
pickup system 220 is approximately aligned with an ex- 
tension line of the optical axis 0 1 of the display system 
210 on the side of the observing eye E. Numeral 222 
designates an entrance pupil of the imaging optical sys- 
tem 221 . 

[0064] The outside image information picked up by 



the image pickup system 220 is processed by the signal 
processing means SP to be converted into an electric 
signal and thereafter it is displayed on the-display 
means 211 and guided to the observing eye E by the 
5 display system 21 0. The apparatus is constructed so as 
to permit the observer to observe the outside object OB 
as if to see it by the naked eye. 

[0065] At this time, particularly, the angle of image 
pickup view of the outside image by the image pickup 

10 system 220 (which is determined by the size of the im- 
age pickup device 223, the focal length of the imaging 
optical system 221 , and the positional relation between 
them) is approximately matched with the angle of dis- 
play view of the display system 21 0 (which is determined 

15 by the size of the display element of the display means 
21 1 , the focal length of the eyepiece optical system 212, 
and the positional relation between them), whereby an 
outside observation magnification in the video 
seethrough observation (to observe the image informa- 

20 tion on the display means 211) is equated to that in the 
observation by the naked eye. 

[0066] In the present embodiment, another potential 
configuration is such that the angle of image pickup view 
of the image pickup system 220 is preliminarily set 

25 slightly larger than the angle of display view of the dis- 
play system 21 0 : part of the outside image taken by the 
image pickup system is cut off so as to make the angle 
of view equal to the angle of display view of the display 
system, and the outside image thus cut is displayed on 

30 the display means 211 of the display system 210, there- 
by permitting 1:1 observation of the two images. 
[0067] Fig. 10 is a schematic diagram to show the 
main part of a conventional image observation device. 
The elements having the same functions as those in the 

35 present embodiment illustrated in Fig. 1 are denoted by 
the same reference symbols and the description thereof 
is omitted herein. 

[0068] As illustrated in Fig. 10, the conventional im- 
age observation device was constructed so that the en- 

40 trance pupil 222 of the imaging optical system 221 of 
the image pickupsystem 220 was located at the position 
optically equivalent to the entrance pupil P of the ob- 
serving eye E. Numeral 222* denotes a mirror image of 
the entrance pupil 222 of the imaging optical system 221 

45 formed by the mirror 213. When the outside is observed 
as displayed on the display means 211 by the device of 
this structure s there arises the problem that the object 
OB existing in the outside is perceived in the size a little 
smaller than that in the case of the observation by the 

50 naked eye. 

[0069] In order to solve this problem, the present in- 
vention involves such arrangement that the imaging op- 
tical system 221 and the image pickup device 223 of the 
image pickup system 220 are shifted toward the outside 

55 from the positions thereof in the conventional device 
(Fig. 10) (i.e., they are moved toward the mirror 213), 
as illustrated in Fig. 1 ; that is, the entrance pupil position 
222 of the image pickup optical system 221 of the image 
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pickup system 220 is shifted by a shift amount d toward 
the outside up to a point 222' relative to the entrance 
pupil position P of the ocular optical system of the ob- 
server, thereby solving the problem. 
[0070] This configuration allows the perception of the 5 
size of the object to agree with that in the observation 
by the naked eye while maintaining the positional rela- 
tion of the outside space, thereby permitting the obser- 
vation of the outside without uncomfortable feeling. 
Since the optical elements can be placed near the en- 10 
trance pupil R the optical systems can be realized in 
compact structure. 

[0071] In the present embodiment, if this shift amount 
d is set too large , it will greatly affect the sense of dis- 
tance of object in the space of distance close to the ob- 15 
server (for example, within about 300 mm), whereby the 
observer will feel that the object is located at the position 
closer than in the observation by the naked eye. 
[0072] It is thus desirable that the shift amount d be 
not more than 60 mm and, preferably, not less than 5 20 
mm and not more than 60 mm. Particularly, when the 
shift amount d is set in the range of not less than 1 0 mm 
nor more than 40 mm, the influence on the sense of dis- 
tance becomes little perceived. 

25 

(Embodiment 2) 

[0073] Fig. 2 is a schematic diagram to show the main 
part of Embodiment 2 of the image observation appara- 
tus according to the present invention. The image ob- 30 
servation apparatus S according to the present embod- 
iment has the display system 230 for guiding the image 
information displayed on the display means 231 to the 
observing eye E, and the image pickup system 240 for 
imaging the image information of the outside on the im- 35 
age pickup device 244. The image information acquired 
by the image pickup system 240 is processed by the 
signal processing means SP to be converted into an 
electric signal and thereafter it is displayed on the dis- 
play means 231 of the display system 230 to be ob- 40 
served, together with the other image information dis- 
played on the display means 231 , by the observing eye 
E. 

[0074] The display system 230 has the display means 
231 such as the LCD, the EL panel, or the like, a half- 45 
silvered mirror 232, and a concave mirror (eyepiece op- 
tical system) 233 of a spherical surface, an aspherical 
surface, or the like. The image pickup system 240 has 
a mirror 241 , the image pickup optical system (optical 
element) 242 having a positive optical power, and the so 
image pickup device 244 such as the CCD or the like. 
[0075] In the present embodiment, the display light 
based on the image information and emerging from the 
display means 231 , which is composed, for example, of 
the backlight, the polarizer, the transmissive liquid crys- 55 
tal element, etc., is reflected in part by the half-silvered 
mirror 232, the reflected light is then reflected by the 
concave mirror 233 and then transmitted in part by the 



half-silvered mirror 232 to be guided to the entrance pu- 
pil P of the observing eye E. The position, the focal 
length, etc. of the concave mirror 233 are determined 
so as to form an enlarged virtual image of the display 
element surface of the display means 231 , for example, 
2 m ahead, and the exit pupil thereof is matched with 
the entrance pupil P of the observing eye E. 
[0076] On the other hand, the tight from the object OB 
in the outside is reflected by the mirror 241 to be focused 
on the image pickup device 244 by the imaging optical 
system 242. The outside optical axis 0 4 of the image 
pickup system 240 is approximately aligned with an ex- 
tension line of the optical axis 0 3 of the display system 
230 on the side of the observing eye E. 
[0077] The outside image, information picked up by 
the image pickup system 240 is displayed on the display 
means 231 to be guided to the observing eye E by the 
display system 230, whereby the observer can observe 
the outside as if to see it by the naked eye. 
[0078] The entrance pupil 243 of the imaging optical 
system 242 (numeral 243* indicating a mirror image of 
the entrance pupil 243 formed by the mirror 241 ) is shift- 
ed by the distance d toward the outside relative to the 
entrance pupil P of the observing eye E, thereby permit- 
ting the observation of the outside without uncomforta- 
ble feeling for the reason similar to that described in Em- 
bodiment 1 . 

(Embodiment 3) 

[0079] Fig. 3 is a schematic diagram to show the main 
part of Embodiment 3 of the image observation appara- 
tus according to the present invention. The image ob- 
servation apparatus S according to the present embod- 
iment has the display system 250 for guiding the image 
information displayed on the display means 251 to the 
observing eye E, and the image pickup system 260 for 
imaging the image information OB of the outside on the 
image pickup device 266. The image information ob- 
tained by the image pickup system 260 is displayed on 
the display means 251 to be observed, together with the 
other image information displayed on the display means 
251 , by the observing eye E. 

[0080] The display system 250 has the display means 
251 such as the LCD, the EL panel, or the like, and a 
prism body PR1 having imaging action. The image pick- 
up system 260 has a prism PR2 each surface of which 
is a plane, the image pickup optical system 264 having 
a positive optical power, and the image pickup device 
266 such as the CCD or the like. 

[0081] In the present embodiment, the outgoing dis- 
play light based on the image information and emerging 
from the display means 251 , which is composed, for ex- 
ample, of the backlight, the polarizer, the transmissive 
liquid crystal device, etc., is incident to the prism body 
PR1 while being refracted by a surface 252 of the prism 
body PR1. The incident light is then incident at angles 
of incidence over the critical angle to a surface 253 to 
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be reflected totally. The reflected light is then reflected 
by a mirror surface 254 of a curved surface to be incident 
at angles of incidence below the critical angle to the sur- 
face 253. The light incident to the surface 253 emerges 
from the prism body PR1 while being refracted by the 
surface 253. The emergent light is then guided to the 
entrance pupil P of the observing eye E. 
[0082] In order to correct well for aberration caused 
by the placement of the surface 254 with the optical pow- 
er inclined relative to the optical axis O s , the prism body 
PR1 is constructed of decentered, rotationafly asym- 
metric surfaces with optical powers differing depending 
upon azimuthal angles, thereby reducing the size of the 
eyepiece optical system. 

[0083] The position, the focal length, etc. of the prism 
body PR1 are determined so as to form an enlarged vir- 
tual image of the display element surface of the display 
means 251, for example, 2 m ahead, and the exit pupil 
thereof is matched with the entrance pupil P of the ob- 
serving eye E. 

[0084] On the other hand, the light from the object OB 
in the outside is incident to the prism PR2 while being 
refracted by the surface 261 . The incident light is reflect- 
ed by the mirror surface 262 and the reflected light is 
then incident at angles of incidence over the critical an- 
gle to the surface 261 to be reflected totally. The reflect- 
ed light is then incident at angles of.incidence below the 
critical angle to the surface 263. The light emerges from 
the prism PR2 while being refracted by the surface 263. 
The emergent light is then focused on the image pickup 
device 266 by the imaging optical system 264. 
[0085] Although each of the surfaces of the prism PR2 
is a plane, any one of them may be formed of a curved 
surface. The outside optical axis O s of the image pickup 
system 260 is approximately aligned with an extension 
line of the optical axis O s of the display system 250 on 
the side of the observing eye E. 
[0086] The outside image information picked up by 
the image pickup system 260 is displayed on the display 
means 251 and is guided to the observing eye E by the 
display system 250, whereby the observer can observe 
the outside as if to see it by the naked eye. 
[0087] In the present embodiment, if the optical sys- 
tem were constructed of mirror surfaces instead of the 
prism PR2, as illustrated in Fig. 4, i.e., if the optical sys- 
tem were constructed using a half-silvered mirror 268 in 
place of the surface 261 of the prism PR2 and similarly 
using a mirror 269 in place of the surface 262, stray light 
(for example, beam 267) from directions other than the 
image pickup directions would enter the image pickup 
device 266 to form a ghost image. 
[0088] In order to solve it, the present embodiment is 
arranged so that the total internal reflection condition is 
met on the occasion of reflection of light at the surface 
261 with the transmission and reflection action in the 
prism PR2. This can prevent the light from the directions 
other than the image pickup directions from entering the 
image pickup device 266, further permits folding of the 



optical axis O e to increase degrees of freedom of the 
layout of the optical system, and also permits reduction 
in the size of the apparatus. 

[0089] Use of total internal reflection permits the out- 
5 side light to be guided efficiently to the image pickup de- 
vice 266, thereby obtaining a bright image. 
[0090] In the present embodiment the apparatus may 
also be constructed in such structure, as illustrated in 
Fig. 5, that a polarizer 21 01 is placed on the outer side 
10 of the half-silvered mirror 268, that a quarter wave plate 
2102 is on the outer side of the mirror 269, and that a 
polarizer 21 03, the axis of absorption of which is set per- 
pendicularto that of the polarizer 2101 , is placed imme- 
diately in front of the image pickup optical system 264. 
*5 This structure can prevent the beam 267 from entering 
the image pickup device 266. 

[0091] Since the light from the image pickup direc- 
tions travels through the quarter wave plate 2102 twice, 
the direction of polarization of the light is rotated by 90° 
20 and the light travels through the polarizer 2103 to be 
guided to the image pickup device 266 by the imaging 
optical system 264. The occurrence of the ghost image 
can be avoided by constructing the image pickup optical 
system using the half-silvered mirror as described 
above, but this structure requires the expensive device 
such as the wave plate, and also tends to be complex. 
[0092] The entrance pupil 265 of the image pickup op- 
tical system 264 (numeral 265' indicating an image of 
the entrance pupil 265 formed by the prism PR2) is shift- 
ed by the distance d toward the outside relative to the 
entrance pupil P of the observing eye E, thereby permit- 
ting the observation of the outside without uncomforta- 
ble feeling for the reason similar to that discussed in Em- 
bodiment 1 . 

[0093] The present embodiment enables the entire 
apparatus to be constructed in compact structure, by 
setting the folding (deflecting) direction of the optical ax- 
is of the image pickup system 260 to the direction dif- 
ferent from that of the display system 250 as illustrated 
in Fig. 3. These folding directions do not always have to 
be opposite to each other, but they may be set, for ex- 
ample, to mutually orthogonal directions as illustrated in 
Fig. 6. 

[0094] In Fig. 6 the display system 250 has the same 
function as in Embodiment 3 illustrated in Fig. 3. On the 
other hand, the light from the object OB in the outside 
is incident to the prism PR3 while being refracted by the 
surface 271 . The incident light is then reflected by the 
mirror surface 272 and the reflected light is incident at 
angles of incidence over the critical angle to the surface 
271 to be reflected totally. The reflected light is then in- 
cident at angles of incidence below the critical angle to 
the surface 273 to emerge from the prism PR3 while be- 
ing refracted thereby. The emergent light is focused on 
the image pickup device 276 by the imaging optical sys- 
tem 274. 
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(Embodiment 4) 

[0095] Fig. 7 is a schematic diagram to show the main 
part of Embodiment 4 of the image observation appara- 
tus according to the present invention. The present em- 
bodiment is different from Embodiment 3 of Fig. 3 only 
in that the image pickup system 280 rep-laces the image 
pickup system 260, and the other structure is the same. 
[0096] In Fig. 7 the display system 250 has the same 
function as in Embodiment 3 illustrated in Fig. 3. The 
light from the object OB in the outside is incident to the 
prism body PR4 while being refracted by a surface 281 . " 
The incident light is then reflected by a mirror surface 
282 of a curved surface and the reflected light is again 
incident at angles of incidence over the critical angle to 
the surface 281 to be reflected totally. The reflected light 
is then incident at angles of incidence below the critical 
angle to a surface 283 to emerge from the prism body 
P R4 while being refracted by the surface 283. The emer- 
gent light is then focused on the image pickup device 
285. 

[0097] In order to correct well for the aberration 
caused by the placement of the curved surface 282 with 
optical power inclined, the prism body PR4 is construct- 
ed of decentered, rotationally asymmetric surfaces with 
optical powers differing depending upon azimuthal an- 
gles, thereby realizing the image pickup optical system 
in the compact structure. 

[0098] The entrance pupil 284 of the image pickup op- 
tical system (PR4) is shifted by the distance d toward 
the outside relative to the entrance pupil P of the observ- 
ing eye E, thereby permitting the observation of the out- 
side without uncomfortable feeling for the reason similar 
to that discussed in Embodiment 1 . 
[0099] Figs. 8A and 8B are block diagrams to show 
the main part of signal processing in the image obser- 
vation apparatus of the present invention. In the present 
invention, the image displayed on the display means 
291 can be a display of the outside image information 
as it is acquired by the image pickup system 290, as 
illustrated in Fig. 8A, but a synthetic image may also be 
displayed on the display means 291 by combining the 
outside image information acquired by the image pickup 
system 290 with image information generated by an im- 
age generating means 292 (which is an image generat- 
ed by computer graphics or the like, an image recorded 
by a video system or the like, etc.) in an image combin- 
ing means 293, as illustrated in Fig. 8B. 
[0100] When a pair of image observation devices S 
as described in either of the above embodiments are 
provided for the left and right eyes of the observer as 
illustrated in Fig. 9, stereoscopic vision can be present- 
ed by use of binocular parallax, whereby an image ob- 
servation system can be constructed with performance 
to permit the observer to observe the outside in a more 
natural state. 

[0101] In the above embodiments, the display ele- 
ment was the transmissive liquid crystal device, but it 



can be a reflective liquid crystal device or a self-emissive 
device such as the EL device or the like. 
[01 02] Figs. 1 1 to 1 5B are explanatory diagrams to il- 
lustrate the basic concept of the image observation sys- 

5 tern of the present invention. The image observation 
system according to the present invention is provided 
with a pair of image observation devices each having 
the display system 20 and the image pickup system 10, 
for the left and right eyes of the observer. Each member 

10 for the right eye is accompanied by suffix R, while each 
member for the left eye by suffix L. E represents the ob- 
serving eyes of the observer. 

[0103] In Fig. 11 , each display system 20 (20L, 20R) 
has the display optical system 21 (21 L, 21 R) and the 
15 display element 22 (22L, 22R) and numeral 23 (23L, 
23R) designates the eye-side optical axis of the display 
optical system 21 . The optical axes 23R, 23L of the dis- 
play optical systems 21 for the left and right eyes are 
set in parallel to each other. Each mirror 14 (14L, 14R) 
separates optical paths of the image pickup system 1 0 
(1 OL, 1 0R) from those of the display system 20. , 
[0104] The position, the focal length, etc. of the dis- 
play optical systems 21 are determined so as to form an 
enlarged virtual image of the display element surface of 
the display element 22, for example, 2 m ahead of the 
observing eye E. Each plane 22' (22'L 22'R) is a virtual 
screen (a virtual image screen) which is conjugate with 
the display surface of the display element 22 with re- 
spect to the display optical system 21 and on which a 
virtual image is formed. 

[0105] Each display element 22 is positioned so that 
the center 22C thereof (22CL, 22CR) is shifted from an 
intersection 23A (23AL, 23AR) between the optical axis 
23 of the display optical system 21 and the display ele- 
ment 22. The shift amount of the centers 22C is set so 
that the centers of the virtual image screens 22'R, 22'L 
of the display systems 20R, 20L for the left and right 
eyes are matched at a point 30, and it is a distance D 
on the virtual image screens 22'. 
[0106] The shift directions are different between the 
display systems 20L, 20R for the left and right eyes and 
the distance D is half of the eye-to-eye distance of the 
observer. This matches the virtual image screens 22'R, 
22'L of the display systems 20R, 20L for the left and right 
eyes with each other. 

[01 07] Each image pickup system 1 0 is comprised of 
the image pickup optical system 11 (11 L, 11R) and the 
image pickup device 12 (12L, 12R), and numeral 13 
(1 3L, 1 3R) designates the optical axis of the image pick- 
up optical system on the exterior side. The optical axes 
1 3R, 1 3L of the image pickup optical systems for the left 
and right eyes are set in parallel to each other and are 
approximately aligned with the optical axes 23 R, 23L of 
the respective display optical systems for the left and 
right eyes. Each image pickup optical system 11 forms 
an image of the outside on the image pickup device 12. 
[01 08] Each surface 1 2' is a focal plane at the position 
conjugate with the image pickup device 12 with respect 
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to the image pickup optical system 1 1 . 
[0109] Each image pickup optical system 11 consists 
of an optical system with a deep depth of field, so that 
an object before and after the focal plane 1 2' R, 1 2' L is 
imaged in focus on the image pickup device 12. Each 5 
image pickup device 12 is designed so that the center 
12C (12CL, 12CR) thereof is shifted from an intersection 
13A (13AL 13AR) between the optical axis 13 of the 
image pickup optical system and the image pickup de- 
vice 12. The shift amount of the centers is set so that 10. 
the centers of the focal planes 12'R, 12'L of the image 
pickup systems 1 0R, 1 0L for the left and right eyes are 
matched at the point 30, and it is the distance D on the 
focal planes 12'. 

[0110] The shift directions are different between the 15 
image pickup systems 10L, 10R for the left and right 
eyes, and the distance D is half of the eye-to-eye dis- 
tance of the observer. This matches the focal planes 
1 2' R, 12'L of the image pickup systems 1 0R, 10Lforthe 
:left and right eyes with each other. 20 
[0111] Fig. 12 and Fig. 13 are diagrams to show states 
of image pickup, display, and observation of the object 
40 in the outside space. In Fig. 12, images 41 (41 L, 41 R) 
of the object 40 in the outside space are formed on the 
image pickup devices 12 (12L, 12R) by the mirrors 14 25 
and the image pickup optical systems 1 1 , and are picked 
up. The positions of the images are indicated by 41 1 
(41 'L, 41'R) on the focal planes 12' conjugate with the 
image pickup devices 1 2 (1 2L, 1 2R) and they are locat- 
ed at the distances of T (TL, TR) from the center 30 of 30 
the focal planes. 

[0112] Theimages41 of the object 40 with in the depth 
of field, which were picked up by the image pickup sys- 
tems 10, are displayed as images 42 on the display el- 
ements 22 as illustrated in Fig. 13. In Fig. 13, light from 35 
each display element 22 is guided to the observing eye 
E by the mirror 14 and the display optical system 21. 
The images 42 are observed as images 42' on the virtual 
image screens 22' conjugate with the display elements 
. 22, by the corresponding observing eyes E. The posi- 40 
tions of the images 42' are distances of U (UL, UR) apart 
from the center 30 of the virtual image screens. 
[0113] The observer observes the image 42*R by the 
right eye ER and the image 42* L by the left eye EL. This 
permits the observer to observe the object 40 as if the 45 
object actually exists at an intersection 44 between the 
visual axis 43R of the right eye ER and the visual axis 
43L of the left eye EL (stereoscopic observation). 
[0114] Since this structure permits the overlapping 
range between the observation fields of the left and right 50 
eyes to be set large, it can avoid difficulties in observa- 
tion due to occurrence of binocular rivalry. Further, even 
in the cases wherein the image pickup optical systems 
1 1 are composed of zoom lenses and undergo zooming 
or in the cases wherein the display magnification is al- 55 
tered by use of an electronic zoom or the like, the struc- 
ture prevents the reproduced space from being distorted 
and permits the observer to conduct the fusion of left 



and right images successfully without stress. 
[0115] The description will be continued with refer- 
ence to Fig. 14, Fig. 15A S and Fig. 15B. Fig. 14 is a case 
wherein the picked up images 41 by the image pickup 
systems 10, of the object 40 in the outside space, illus- 
trated in Fig. 12 : are displayed at the magnification of 
x2 on the display elements 22. In this case, the distanc- 
es V from the screen center 30, of the display images 
45* on the virtual image screens 22' are twice the dis- 
tances U in Fig. 13. Just as in the case of Fig. 13, the 
observer can observe the object 40 as if it is actually 
present at an intersection 47 between the visual axis 
46R of the right eye ER and the visual axis 46L of the 
left eye EL. 

[0116] In the image observation system according to 
the present invention, different from the conventional 
systems, the visual axes of the left and right eyes inter- 
sect with each other (to permit the fusion of left and right 
images) even if the object 40 is not present in the XZ 
plane (Y * O). Fig. 15A is a YZ cross section in the state 
illustrated in Fig. 13, and Fig. 15B a YZ cross section in 
the state illustrated in Fig. 14. 

[0117] In Figs. 15A and 1 5B, the suffix y attached to 
U and V represents a Y-directional component thereof. 
As illustrated in Figs. 15A and 15B, the virtual image 
screens of the left and right eyes are always matched 
with respect to the Z-direction. Therefore, independent 
of the position of the object 40, the distance UyR and 
the distance UyL are always equal and the distance VyR 
and the distance VyL are always equal to each other. 
Regardless of whether the zooming function is used or 
not, the visual axes 43R and 43L and the visual axes 
46R and 46L of the left and right eyes ER, EL are 
matched in the YZ plane, as illustrated in Figs. 15A and 
15B S and thus they intersect with each other, thus per- 
mitting the fusion of the left and right images. 
[0118] In Fig. 12 and Fig. 13, when the entrance pupil 
position of each image pickup optical system 11 is 
matched with the entrance pupil position of the corre- 
sponding observing eye E and when the angle of image 
pickup view is matched with the angle of display view, 
the position and size of the focal planes 12' of the image 
pickup systems become equal to those of the virtual im- 
age screens 22' of the display systems 20, so that the 
distances T become equal to the distances U. 
[0119] Therefore, the position of the intersection 44 
becomes identical to the actual position of the object 40 
in the outside space and the size of the reproduced ob- 
ject also becomes equal to that of the object 40. 
[0120] Even in the cases wherein the entrance pupil 
positions of the image pickup optical systems 11 are not 
matched with the entrance pupil positions of the observ- 
ing eyes E or in the cases wherein the angle of image 
pickup view is not matched with the angle of display 
view, the reproduced space is free of distortion and the 
observer can succeed in the fusion of the left and right 
images for the reason illustrated in Figs. 15A and 15B. 
[0121] In the example described above, the focal 
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planes 12' (12'R, 12'L) of the image pickup systems are 
matched with the virtual image screens 22' (22'R, 22'L) 
of the display systems 20, but the present invention is 
not limited to this. 

[0122] When the focal planes 12'R and 12'L of the im- 
age pickup systems 10 for the left and right eyes are 
matched with each other and when the virtual image 
screens 22'R and 22'L of the display systems 20 for the 
left and right eyes are matched with each other, the y- 
directional picking-up image heights TyR and TyL of the 
image pickup systems 10 for the left and right eyes be- 
come matched with each other and the y-directional dis- 
play image heights UyR and UyL of the display systems 
20 for the left and right images also with each other, 
whereby the reproduced space is free of distortion and 
the observer can succeed in the fusion of the left and 
right images without stress for the reason illustrated in 
Figs. 15A and 15B. 

[01 23] Specific embodiments of the present invention 
will be described below. 

(Embodiment 5) 

[0124] Fig. 16 is a schematic diagram to show the 
main part of Embodiment 5 of the image observation 
system according to the present invention. Fig. 16 
shows an image observation device WL for the left eye 
in the image observation system of the present inven- 
tion. Although each member for the left eye is illustrated 
with the suffix L in the drawing, the suffix will be omitted 
in the description below. 

[0125] The image observation device W according to 
the present embodiment has the display system 20 for 
guiding the image information displayed on the display 
element 22 to the observing eye E, and the image pickup 
system 1 0 for imaging the image information of the out- 
side on the image pickup device 12. The image infor- 
mation obtained by the image pickup system 10 is dis- 
played on the display element 22 of the display system 
20 and is observed by the observing eye E. 
[0126] The display system 20 has the display element 
22 such as the LCD, the EL panel, or the like, a half- 
silvered mirror24, and a concave mirror 21 , and numer- 
al 23 designates the optical axis thereof. The image 
pickup system 10 has a mirror 15, the image pickup op- 
tical system 11 having a positive optical power, and the 
image pickup device 12 such as the CCD or the like, 
and numeral 13 designates the optical axis thereof. 
[0127] In the present embodiment, the display light 
emerging from the display element 22, which is com- 
posed, for example, of the backlight, the polarizer, the 
transmissive liquid crystal device, etc., is reflected in 
part by the half-silvered mirror 24 and the reflected light 
is then reflected by the concave mirror 21 to be guided 
to the observing eye E. The position, the focal length, 
etc. of the concave mirror 21 are determined so as to 
form an enlarged virtual image of the display element 
22, for example, 2 m ahead of the observer, and the exit 



pupil thereof is matched with the entrance pupil of the 
observing eye E. The center of the display element 22 
is shifted by the amount illustrated in Fig. 11 from the 
intersection 25 between the display element 22 and the 
5 optical axis 23. 

[0128] On the other hand, the light from the outside is 
reflected by the mirror 15 to be focused on the image 
pickup device 1 2 by the image pickup optical system 1 1 . 
The optical axis 1 3 of the image pickup system is ap^ 
10 proximately aligned with the optical axis 23 of the display 
system. The center of the image pickup device 12 is 
shifted by the amount illustrated in Fig. 11 from the in- 
tersection 1 6 between the image pickup device 1 2 and 
the optical axis 13. The entrance pupil position of the 
is image pickup optical system 1 1 is matched with the en- 
trance pupil position of the observing eye E. 
[0129] The outside image information picked up by 
the pickup system 1 0 is displayed on the display ele- 
ment 22 and is guided to the observing eye E by the 
display system 20, whereby the observer can observe 
the outside as if to see it by the naked eye. 
[0130] In this case, particularly, when the angle of im- 
age pickup view of the outside image by the image pick- 
up system 10 (which is determined by the size of the 
image pickup device 12, the focal length of the image 
pickup optical system 11 , and the positional relation be- 
tween them) is approximately matched with the angle of 
display view of the display system 20 (which is deter- 
mined by the size of the display element 22, the focal 
length of the concave mirror 21 , and the positional rela- 
tion between them), the outside observation magnifica- 
tion in the video seethrough observation can equate with 
that in the observation by the naked eye. It is, however, 
noted that the same effect can also be achieved by set- 
ting the angle of image pickup view of the outside image 
by the image pickup system 10 slightly larger than the 
angle of display view of the display system 20, cutting 
off part of the outside image picked up so as to realize 
1:1 observation, and displaying the trimmed image on 
the display element 22 of the display system 20. 
[0131] The image observation system of the present 
invention is used while the image observation device 
WL for the left eye of Fig. 1 6 and the image observation 
device WR for the right eye in the relation illustrated in 
Fig. 11 relative to Fig. 16 are mounted on the head as 
illustrated in Fig. 17. 

[0132] For the reason illustrated in Figs. 11 to 15B, 
this structure prevents the reproduced space from being 
distorted and permits the observer to succeed in the fu- 
sion of the left and right images without stress even in 
the cases using the zooming function, in the cases 
wherein the angle of image pickup view is not matched 
with the angle of display view because of the design fac- 
tors, manufacturing errors, etc., in the cases wherein the 
entrance pupil position of the image pickup optical sys- 
tem is not matched with that of the observing eye, and 
so on. 

[0133] Further, when each image pickup optical sys- 
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tern 11 is comprised of a zooming optical system, the 
image observation system can present such an effect 
that the observer can observe the object as if it became 
closer or it became larger. 

[0134] For the description below, the explanatory di- 5 
agrams show only the image observation device WL for 
the left eye for the sake of simplicity. 

, (Embodiment 6) 

10 

[0135] Fig. 18 is a schematic diagram to show the 
main part of Embodiment 6 of the image observation 
system according to the present invention. 
[0136] The display system 20 has the display element 
22 such as the LCD, the EL panel, or the like, and a 15 . 
prism body 26. The image pickup system 1 0 has a prism 
1 7 constructed of planes, the imaging optical system 1 8 
having a positive optical power, and the image pickup 
device 16 such as the CCD or the like. 
[0137] In the present embodiment, the display light 20 
emerging from the display element 22, which is com- 
posed, for example, of the backlight, the polarizer, the 
transmissive liquid crystal device, etc., is incident to the 
prism body 26 while being refracted by a surface 27 
thereof. The incident light is then incident at angles of 25 
incidence over the critical angle to a surface 28 to be 
reflected totally. The reflected light is then reflected by 
a mirror surface 29 to be again incident at angles of in- 
cidence below the critical angle to the surface 28. The 
light emerges from the prism body 26 while being re- 30 
f racted by the surface 28. The emergent light is guided 
to-the observing eye E. In order to correct well for the 
aberration caused by the placement of the surface with 
the optical power inclined, the prism body 26 is con- 
structed of decentered, rotationally asymmetric surfac- 35 
es with optical powers differing depending upon azi- 
muthal angles, whereby the display optical system is 
constructed in compact structure. The position, the focal 
length, etc. of the prism body 26 are determined so as 
to form an enlarged virtual image of the display element 40 
22, for example, 2 m ahead of the observing eye E, and 
the exit pupil thereof is matched with the entrance pupil 
of the observing eye E. 

[0138] Here the prism body 26 composes the display 
optical system 21 and the eye-side optical axis 23 there- 45 
of is one defined as a straight line being perpendicular 
to the plane of the virtual image screen 22' (not illustrat- 
ed) formed by the display optical system 21 of the dis- 
play element 22 and passing the center of the exit pupil 
of the display optical system 21 . so 
[0139] On the other hand, the light from the outside is 
incident to the prism 1 7 while being refracted by a sur- 
face 51 thereof. The incident light is reflected by a mirror 
surface 52 and the reflected light is incident at angles 
of incidence over the critical angle to the surface 51 to 55 
be reflected totally. The reflected light is then incident at 
angles of incidence below the critical angle to a surface 
53. The light incident to the surface 53 emerges from 



the prism 1 7 while being refracted thereby. The emer- 
gent light is focused on the image pickup device 12 by 
the imaging optical system 1 8. The optical axis 13 of the 
image pickup system 10 is approximately aligned with 
the optical axis 23 of the display system 20. The en- 
trance pupil position of the image pickup optical system 
comprised of the prism body 1 7 is matched with the en- 
trance pupil position of the observing eye E. 
[0140] The center of the display element 22 is shifted 
from the intersection 25 between the display element 22 
and the optical axis 23 and the center of the image pick- 
up device 1 2 from the intersection 1 6 between the image 
pickup device 12 and the optical axis 13, each by the 
amount illustrated in Fig. 11 . 

[0141] The outside image information picked up by 
the image pickup system 10 is displayed on the display 
element 22 and is guided to the observing eye E by the 
display system 20, whereby the observer can observe 
the outside as if to see it by the naked eye. 
[0142] For the reason illustrated in Figs. 11 to 15B, 
this structure makes the reproduced space free from 
distortion and permits the observer to effect the fusion 
of the left and right images successfully without stress 
even in the cases using the zooming function; in the cas- 
es wherein the angle of image pickup view is not 
matched with the angle of display view because of the 
design factors, manufacturing errors, etc., in the cases 
wherein the entrance pupil position of the image pickup 
optical system is not matched with the entrance pupil 
position of the observing eye, and so on. 
[0143] The entire apparatus can be constructed in 
compact structure by setting the folding (deflecting) di- 
rection of the optical axis 23 of the display system 20 to 
the direction different from that of the image pickup sys- 
tem 10 as illustrated in Fig. 19. In Fig. 19 the display 
system 20 and the image pickup system 10 have the 
same functions as in Embodiment 6 illustrated in Fig. 
18, and the center of the display element 22 is shifted 
from the intersection 25 between the display element 22 
and the optical axis 23 and the center of the image pick- 
up device 1 2 from the intersection 1 6 between the image 
pickup device 12 and the optical axis 13, each by the 
amount illustrated in Fig. 11. 

(Embodiment 7) 

[0144] Fig. 20 is a schematic diagram to show the 
main part of Embodiment 7 of the image observation 
system according to the present invention. The present 
embodiment has the same structure as Embodiment 6 
illustrated in Fig. 19, except that the form (structure) of 
the image pickup system 1 0 is modified. 
[0145] In Fig. 20 the display system 20 has the same 
function as in Embodiment 6 illustrated in Fig. 19. The 
light from the outside is incident to the prism body 54 
while being refracted by a surface 55 of the prism body 
54. The incident light is then reflected by a mirror surface 
56 and is again incident at angles of incidence over the 
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critical angle to the surface 55 to be reflected totally. The 
reflected light is then incident at angles of incidence be- 
low the critical angle to a surface 57 and emerges from 
the prism body 54 while being refracted thereby. The 
emergent light is focused on the image pickup device 
12. 

[0146] In order to correct well for the aberration 
caused by the placement of the surface with the optica! 
power inclined, the prism body 54 is constructed of de- 
centered, rotationally asymmetric surfaces with optical 
powers differing depending upon azimuthal angles, 
whereby the image pickup system 10 can be construct- 
ed in compact structure. 

[0147] The center of the image pickup device 12 is 
shifted from the intersection 1 6 between the image pick- 
up device 12 and the optical axis 13 by the amount il- 
lustrated in Fig. 11. 

(Embodiment 8) 

[0148] Fig. 21 is a schematic diagram to show the 
main part of Embodiment 8 of the image observation 
system according to the present invention. The present 
embodiment has the same structure as Embodiment 6 
illustrated in Fig. 19, except that the form (structure) of 
the image pickup system 10 is modified. 
[0149] In the embodiment illustrated in Fig. 21 , in con- 
trast to Embodiment 6 illustrated in Fig. 19, the entrance 
pupil position of the image pickup optical system 11 
composed of the prism 15 and the imaging optical sys- 
tem 1 9 is shifted toward the outside relative to the en- 
trance pupil position of the observing eye E matched 
with the exit pupil of the display optical system 21 com- 
posed of the prism body 26, thereby constructing the 
apparatus in the compact structure. This structure can 
prevent the reproduced space from looking small be- 
cause of the peeping effect. If the shift amount were set 
too large at this time, the effect on the sense of distance 
to the object would be enhanced in the space of distance 
(for example, about 300 mm) close to the observer, and 
the observer would perceive the object at the position 
closer than in the observation by the naked eye in cer- 
tain cases. Therefore, the shift amount is set better in 
the range of not more than 60 mm. It is desirable that 
the shift amount be preferably not less than 5 mm and 
not more than 60 mm. Particularly, when the shift 
amount is set in the range of not less than 10 mm nor 
more than 40 mm, the effect on the sense of distance 
will be rarely perceived. 

[0150] This structure can also free the reproduced 
space from distortion and permits the observer to effect 
the fusion of the left and right images successfully with- 
out stress for the reason illustrated in Figs. 11 to 15B. 
[0151] In each of the above embodiments, the image 
displayed on the display element 22 can be the outside 
image information as it is captured by the image pickup 
system 10 as illustrated in Fig. 22A, or the image can 
be a synthetic image displayed on the display element 



22 by combining the outside image information captured 
by the image pickup system 1 0 with the image informa- 
tion generated by image generating means 60 (which is 
the image generated by computer graphics or the like, 

5 the image recorded by the video system or the like, etc.), 
in image combining means 61 , as illustrated in Fig. 22B. 
[01 52] In each of the above embodiments the display 
element was the transmissive liquid crystal device, but 
it may also be a reflective liquid crystal device or a self- 

10 emissive device such as the EL device or the like. The 
image pickup device was the CCD, but it may also be a 
device such as a CMOS sensor or the like. 
[0153] According to the present invention, the image 
observation apparatus permitting the observation of the 

15 outside in the same size both in the video seethrough 
observation and in the observation by the naked eye can 
be attained by employing either of the above, structures. 
[0154] The present invention also accomplishes the 
provision of the image observation apparatus that can 
20 reduce the load on the observer in the mounted state 
on the head, while accomplishing the reduction in the 
size of the entire apparatus. 

[0155] According to the present invention, the image 
pickup system is constructed using the prism with one 

25 surface having both the transmission action andthe total 
internal reflection action, so as to reduce the size of the 
entire apparatus and permit the outside light to be guid- 
ed efficiently to the image pickup device, thereby ac- 
complishing the image observation apparatus capable 

30 of readily gaining a bright outside image. 

[0156] The present invention provides the above 
structures to accomplish the image observation sys- 
tems in which the reproduced space is free of distortion 
and which permits the observer to succeed in the fusion 

35 of the images for the left and right eyes without stress 
even in the cases wherein the zooming function is used 
in the video seethrough observation, in the cases 
wherein the angle of image pickup view is not matched 
with the angle of display view because of the design fac- 

40 tors, manufacturing errors, etc., in the cases wherein the 
entrance pupil position of the image pickup optical sys- 
tem is not matched with the entrance pupil position of 
the observing eye, and so on. 

[0157] Since the overlapping range can be set large 
45 between the observation fields of the left and right eyes, 
it can prevent observation from becoming difficult be- 
cause of the binocular rivalry. 

[0158] In an image observation apparatus having an 
image pickup system for acquiring an outside image via 

50 an image pickup optical system and a display system 
for displaying the outside image acquired by the image 
pickup system on a display element and for guiding light 
from the display element via an eyepiece optical system 
to an eye, an outside optical axis of the image pickup 

55 optical system is approximately aligned with an exten- 
sion line of an eye-side optical axis of the eyepiece op- 
tical system, and an entrance pupil of the image pickup 
optical system is shifted toward the outside from a po- 
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sition equivalent to an entrance pupil of the ocular opti- 
cal system. An image observation system has a pair of 
image observation devices for the left and right eyes of 
an observer. Each of the image observation devices has 
an image pickup system for forming an outside image s 
on an image pickup device by an image pickup optical 
system, and a display system for guiding light from a 
display element displaying the outside image acquired 
by the image pickup system, to the observing eye by a 
display optical system. Each of the image observation 10 
devices is arranged so that the outside optical axis of 
the image pickup optical system is approximately 
aligned with an extension line of the eye-side optical axis 
of the display optical system. In the image observation 
system, the image pickup device of the image pickup 15 
system of each image observation device is shifted hor- 
izontally by a predetermined distance relative to the op- 
tical axis of the image pickup optical system, and the 
display element is shifted horizontally by a predeter- 
mined distance relative to the optical axis of the display 20 
optical system. The optical axes of the image pickup op- 
tical systems and the optical axes of the display optical 
systems in the pair of image observation devices for the 
left and right eyes are parallel to each other. 



Claims 

1 . An image observation apparatus comprising an im- 
age pickup system for acquiring an outside image 30 
via an image pickup optical system, and a display 
system for displaying the outside image acquired 

by the image pickup system on display means and 
guiding light from the display means via an eye- 
piece optical system to an eye, in which a position 35 
of an exit pupil of the eyepiece optical system is ap- 
proximately matched with a position of an entrance 
pupil of an ocular optical system, so as to permit 
observation of the image, wherein an outside opti- 
cal axis of the image pickup optical system is ap- *o 
proximately aligned with an extension line of an 
eye-side optical axis of the eyepiece optical system 
and wherein an entrance pupil of the image pickup 
optical system is shifted toward the outside from a 
position equivalent to the entrance pupil of the oc- *s 
ular optical system. 

2. The image observation apparatus according to 
Claim 1 , wherein the following condition is satisfied: 

d < 60 (mm) so 
where d is a shift amount of the entrance pupil 
of said image pickup optical system relative to the 
position equivalent to the entrance pupil of said oc- 
ular optical system. 

55 

3. The image observation apparatus according to 
Claim 1 or 2, wherein an angle of image pickup view 
of the outside image acquired by said image pickup 



system is approximately equated to an angle of dis- 
play view of display by said display system. 

4. The image observation apparatus according to ei- 
ther one of Claims 1 to 3, which comprises image 
generating means for generating an image and im- 
age combining means for combining images, 
wherein said image combining means combines the 
image from the image generating means with the 
image from said image pickup system to form a syn- 
thetic image and displays the synthetic image on 
said display means. 

5. The image observation apparatus according to ei- 
ther one of Claims 1 to 4, wherein said image pickup 
system comprises a prism consisting of a plurality 
of planes, wherein said prism comprises a plane 
having transmission action and total internal reflec- 
tion action, and wherein light having passed 
through the prism is guided to an image pickup de- 
vice by an optical element having a positive optical 
power. 

6. The image observation apparatus according to ei- 
ther one of Claims 1 to 5, wherein said image pickup 
system comprises a decentered, rotational ly asym- 
metric, reflecting surface with optical powers differ- 
ing depending upon azimuthal angles. 

7. The image observation apparatus according to ei- 
ther one of Claims 1 to 6, wherein said display sys- 
tem comprises a decentered, rotationally asymmet- 
ric, reflecting surface with optical powers differing 
depending upon azimuthal angles. 

8. An image observation system wherein a pair of the 
image observation apparatus in either one of 
Claims 1 to 7 are provided for the left and right eyes 
of an observer. 

9. An image observation apparatus comprising an im- 
age pickup system for acquiring an outside image 
via an image pickup optical system, and a display 
system for displaying the outside image acquired 
by the image pickup system on display means and 
guiding light from the display means via an eye- 
piece optical system to an eye, in which a position 
of an exit pupil of the eyepiece optical system is ap- 
proximately matched with a position of an entrance 
pupil of an ocular optical system, so as to permit 
observation of the image, wherein said display sys- 
tem comprises a prism body having a decentered, 
rotationally asymmetric, reflecting surface with op- 
tical powers differing depending upon azimuthal an- 
gles, wherein an outside optical axis of the image 
pickup optical system is approximately aligned with 
an extension line of an eye-side optical axis of the 
eyepiece optical system, wherein an entrance pupil 
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of the image pickup optical system is shifted toward 
the outside from a position equivalent to the en- 
trance pupil of the ocular optical system, and where- 
in, where an amount of the shift is d, the shift amount 
d satisfies the following condition: 
d<60(mm). 

10. The image observation apparatus according to 
Claim 9, wherein said image pickup system com- 
prises a reflecting surface and wherein a direction 
of deflection of the optical axis by the reflecting sur- 
face is a direction different from a direction of de- 
flection of the optical axis by the reflecting surface 
of said display system. 

11. The image observation apparatus according to 
Claim 9 or 10, wherein an angle of image pickup 
view of the outside image acquired by said image 
pickup system is approximately equated to an angle 
of display view of display by said display system. 

12. The image observation apparatus according to ei- 
ther one of Claims 9 to 11 , which comprises image 
generating means for generating an image and im- 
age combining means for combining images, 
wherein said image combining means combines the 
image from the image generating means with the 
image from said image pickup system to form a syn- 
thetic image and displays the synthetic image on 
said display means. 

13. The image observation apparatus according to ei- 
ther one of Claims 9 to 1 2 : wherein said image pick- 
up system comprises a prism consisting of a plural- 
ity of planes, wherein said prism comprises a plane 
having transmission action and total internal reflec- 
tion action, and wherein light having passed 
through the prism is guided to an image pickup de- 
vice by an optical element having a positive optical 
power. 

14. The image observation apparatus according to ei- 
ther one of Claims 9 to 1 2, wherein said image pick- 
up system comprises a decentered, rotationally 
asymmetric, reflecting surface with optical powers 
differing depending upon azimuthal angles. 

15. An image observation system wherein a pair of the 
image observation apparatus in either one of 
Claims 9 to 14 are provided for the left and right 
eyes of an observer. 

16. An image observation system in which a pair of im- 
age observation devices are provided for the left 
and right eyes of an observer, each of said image 
observation devices comprising an image pickup 
system for forming an outside image on an image 
pickup device by an image pickup optical system, 
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and a display system for guiding light from a display 
element displaying the outside image acquired by 
the image pickup system., to the observing eye by 
a display optical system and each of said image ob- 
servation devices being arranged so that an outside 
optical axis of the image pickup optical system is 
approximately aligned with an extension line of an 
eye-side optical axis of the display optical system, 
wherein the image pickup device of the image pick- 
up system of each image observation device is 
shifted horizontally by a predetermined distance rel- 
ative to the optical axis of the image pickup optical 
system, wherein the display element of each image 
observation device is shifted horizontally by a pre- 
determined distance relative to the optical axis of 
the display optical system, and wherein the optical 
axes of the image pickup optical systems and the 
optical axes of the display optical systems in the pair 
of image observation devices for the left and right 
eyes are parallel to each other. 

17. The image observation system according to Claim 
16, wherein focus positions of said image pickup 
optical systems for the left and right eyes are 
matched with each other, shift amounts of said im- 
age pickup devices are set so as to match positions 
conjugate with centers of the respective image pick- 
up devices by the image pickup optical systems for 
the left and right eyes with each other, positions of 
virtual images of said display elements by the dis- 
play optical systems for the left and right eyes are 
matched with each other, and shift amounts of the 
display elements are set so as to match positions 
conjugate with centers of the respective display el- 
ements by the display optical systems for the left 
and right eyes with each other. 



18. The image observation system according to Claim 
17, wherein said focus positions are matched with 
40 said positions of the virtual images. 



19. The image observation system according to either 
one of Claims 16 to 18, wherein an angle of image 
pickup view of the outside image by said image 
pickup system of each image observation device is 
approximately equated to an angle of display view 
of display by said display system. 
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20. The image observation system according to either 
one of Claims 16 to 19, which comprises image gen- 
erating means for generating an image and image 
combining means for combining images, wherein 
said image combining means combines the image 
from the image generating means with the image 
from said image pickup system of each image ob- 
servation device to obtain a synthetic image and 
displays the synthetic image on said display ele- 
ment of each image observation device. 
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21. The image observation system according to either 
one of Claims 1 6 to 20, wherein said image pickup 
optical system of each image observation device 
comprises a prism consisting of planes, said prism 
comprising a plane having transmission action and 5 
total internal reflection action, wherein an optical el- 
ement having a positive optical power is placed in 

an optical path between the prism and said image 
pickup device. 

10 

22. The image observation system according to either 
one of Claims 1 6 to 21 , wherein said image pickup 
optical system of each image observation device 
comprises a decentered, rotationally asymmetric, 
reflective surface with optical powers differing de- 15 
pending upon azimuthal angles. 

23. The image observation system according to either 
one of Claims 1 6 to 22, wherein said display optical 
system of each image observation device compris- 20 
es a decentered, rotationally asymmetric, reflecting 
surface with optical powers differing depending up- 
on azimuthal angles. 

24. The image observation system according to either 25 
one of Claims 16 to 23, wherein said image pickup 
optical systems are zooming optical systems. 

25. The image observation system according to either 
one of Claims 16 to 24, which comprises image 30 
processing means for changing a display magnifi- 
cation when the outside images acquired by said 
image pickup systems are displayed on said display 
elements. 

35 

26. An image observation system in which a pair of im- 
age observation devices are provided for the left 
and right eyes of an observer, each of said image 
observation devices comprising an image pickup 
system for forming an outside image on an image 40 
pickup device by an image pickup optical system, 
and a display system for guiding light from a display 
element displaying the outside image acquired by 

the image pickup system, to the observing eye by 
a display optical system and each of said image qb- ^5 
servation devices being arranged so that an outside 
optical axis of the image pickup optical system is 
approximately aligned with an extension line of an 
eye-side optical axis of the display optical system 
via an optical member, wherein the image pickup so 
device of the image pickup system of each image 
observation device is arranged so that a center 
thereof is shifted by a predetermined distance in a 
direction perpendicular to the optical axis of the im- 
age pickup optical system and wherein the display 55 
element of each image observation device is ar- 
ranged so that a center thereof is shifted by a pre- 
determined distance in a direction perpendicular to 



the optical axis of the display optical system. 

27. The image observation system according to Claim 

26, wherein the outside optical axes of said pair of 
image pickup optical systems for the left and right 
eyes are parallel to each other. 

28. The image observation system according to Claim 

27, wherein positions of an object formed on said 
image pickup devices by said image pickup sys- 
tems are matched with positions where virtual im- 
ages of said display elements are formed by said 
display systems. 

29. The image observation system according to Claim 

28, wherein object-side positions of centers of said 
image pickup devices by said image pickup sys- 
tems are matched with positions where virtual im- 
ages of centers of said display elements are formed 
by said display systems. 

30. The image observation system according to either 
one of Claims 26 to 29, wherein said image pickup 
optical system of each image observation device 
comprises a decentered, rotationally asymmetric, 
reflecting surface with optical powers differing de- 
pending upon azimuthal angles. 

31 . The image observation system according to either 
one of Claims 26 to 30, wherein said display optical 
system of each image observation device compris- 
es a decentered, rotationally asymmetric, reflecting 
surface with optical powers differing depending up- 
on azimuthal angles. 

32. The image observation system according to either 
one of Claims 1 6 to 31 , wherein a position of an en- 
trance pupil of said image pickup optical system of 
each image observation device is shifted toward the 
outside from a position equivalent to an entrance 
pupil of the observer's eye. 

33. The image observation system according to Claim 
32, wherein, where an amount of the shift of the en- 
trance pupil of said image pickup optical system 
from the position equivalent to the position of the 
entrance pupil of said observer's eye is d, the shift 
amount d satisfies the following condition: 

d < 60 (mm). 
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